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RECORDING MEDIUM HAVING A DATA STRUCTURE FOR 
MANAGING REPRODUCTION OF GRAPHIC DATA AND RECORDING 
AND REPRODUCING METHODS AND APPARATUSES 

5 FOREIGN PRIORITY 

[0001] The present invention claims priority under 35 U.S.C. 
1 19 on Korean Application No. 10-2002-060256 filed October 2, 2002; 
the contents of each above-cited Korean applications are incorporated 
by reference in their entirety. 

10 BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to a method of managing 
graphic data for a high-density recording medium such as an optical 
disk (e.g., a Blu-ray Disc ROM (BD-ROM)). 

15 

Description of Related Art 

[0003] Recording media such as optical disks capable of 
recording large amounts of high-quality digital video/audio data, for 
example, DVDs (digital versatile disks) are now commercially 
20 available on the market. The types of DVDs include DVD-Video, 
DVD-VR (Video Recording), DVD-Audio, and DVD-AR (Audio 
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Recording). 

[0004] In the DVD-Video, graphic data to be reproduced in 
synchronization with a video/audio data stream is defined by the 
DVD-private format and designated as sub-pictures. 
5 [0005] A sub-picture of the graphic data is of size 720x480 

pixels and has a palette with 2-bit color depth, which can support up 
to 16 colors. The graphic data is recorded on the DVD after being 
multiplexed with the video/audio stream. 

[0006] A run-length coding method according to the DVD- 

10 Video standard is applied to the graphic data in which display 
control information about sub-picture data is included. The display 
control information includes information on display timing, color 
change, blending ratio change, display position, size selection, etc. 

[0007] Operations for providing various graphic effects to the 

15 graphic data, such as scroll-up/down, fade/wipe-in/out, and color 
change, can be performed selectively on a time basis. Navigation 
information for the palette information is defined for each title and 
program chain and includes information on 16 colors and the 
number and attributes of sub-pictures. 

20 [0008] The attributes of sub-pictures may include caption 

information, director's comments, and aspect ratio information for 
various applications as well as coding mode information and 
language information. 
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[0009] An optical disk reproducing apparatus such as a DVD 
player displays the main video image and some or all of the graphic 
image of a sub-picture unit (SPU) as shown in Fig. 1 by blending the 
images using navigation information, wherein the graphic image of 
5 the sub-picture unit (SPU) is overlaid on the main video image on a 
presentation time basis. 

[0010] As shown in FIG. 2, sub-picture packs (SP_PCKs) are 
recorded intermittently among audio packs (Audio_PCKs) and video 
packs (Video_PCKs) recorded successively. Each of the audio and 
10 video packs is of size 2048 bytes. 

[0011] During data reproduction, the sub-picture packs are 
read and then grouped into a sub-picture unit (SPU), which includes 
a sub-picture unit header, pixel data, and display control 
information. 

15 [0012] The sub-picture unit header includes the data size of 

the sub-picture unit. The pixel data includes 2-bit depth bitmap data 
encoded by the run-length coding method. The palette information 
for the pixel data is recorded as separate navigation information. 

[0013] The optical disk reproducing apparatus reproduces the 

20 pixel data along with the audio and video data, the pixel data being 
synchronized with the audio and video data. As alluded to above, the 
apparatus displays the main video image and some or all of the 
graphic image of a sub-picture unit (SPU) by blending the images 
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using the navigation information, wherein the graphic image of the 
sub-picture unit (SPU) is overlaid on the main video image in various 
ways on a presentation time basis. 

[0014] The standardization for high-density read-only optical 
5 disks such as the Blu-ray disc ROM (BD-ROM) is still under way. A 
method for effective managing graphic data recorded on the high- 
density read-only optical disk such as a BD-ROM is not yet available. 

SUMMARY OF THE INVENTION 
[0015] The recording medium according to the present 
10 invention includes a data structure for managing reproduction of 
graphic data. 

[0016] In one exemplary embodiment, a graphic information 
area of the recording medium includes at least one graphic image 
information segment and at least one palette information segment. 

15 Each palette information segment provides color information, and 
each graphic image information segment provides reproduction 
information for reproducing one or more graphic images. 

[0017] In an exemplary embodiment, the reproduction 
information identifies a palette information segment to use in 

20 reproducing one or more graphic images. For example, each palette 
information segment may have an identifier, and the reproduction 
information identifies a palette information segment using the 
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identifier for the palette information segment. 

[0018] In another exemplary embodiment, the palette 
information segment includes a blending ratio indicating a level of 
opacity for the associated color information. In a further exemplary 
5 embodiment, the palette information segment includes a blending 
ratio indicating a level of transparency for the associated color 
information. 

[0019] The present invention further provides apparatuses and 
methods for recording and reproducing the data structure according 
10 to the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0020] The accompanying drawings, which are included to 
provide a further understanding of the invention, illustrate the 
preferred embodiments of the invention, and together with the 
15 description, serve to explain the principles of the present invention. 
[0021] In the drawings: 

[0022] FIG. 1 illustrates a graphical representation of main 
video overlaid with graphic images according to the DVD Video 
standard; 

20 [0023] FIG. 2 illustrates a structure of graphic data in the 

DVD-Video standard; 

[0024] FIG. 3 illustrates a graphical representation of an 
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embodiment of a method of managing graphic data for a high-density 
recording medium in accordance with the invention; 

[0025] FIG. 4 illustrates a graphical representation of the main 
data overlaid with a plurality of graphic images of different sizes and 
5 color depths; 

[0026] FIG. 5 is a flow diagram illustrating an embodiment of a 
method of managing graphic data in accordance with the invention; 

[0027] FIGS. 6-8 illustrate embodiments of palette information 
in accordance with the invention; 
10 [0028] FIG. 9 illustrates an embodiment of the navigation 

information for graphic images recorded on a high density recording 
medium in accordance with the invention; 

[0029] FIG. 10 illustrates exemplary pixel groups according to 
the invention; 

15 [0030] FIG. 11 illustrates a schematic diagram of an 

encoding/decoding apparatus using the graphic coding format of the 
DVD-Video standard; 

[0031] FIGS. 12 through 16 illustrate schematic diagrams of 
first through fifth embodiments of encoding/decoding apparatuses of 

20 the invention; 

[0032] FIG. 17 is a flow diagram illustrating a method of 
limiting the data size of an encoded image in accordance with the 
invention; and 
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[0033] Fig. 18 illustrates a schematic diagram of an 
embodiment of an optical disk recording and reproducing apparatus 
according to the present invention. 

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS 
5 [0034] In order that the invention may be fully understood, 

exemplary embodiments thereof will now be described with reference 
to the accompanying drawings. 

[0035] FIG. 3 is a graphical representation of an embodiment 
of a method of managing graphic data for a high-density recording 
10 medium such as an optical disk in accordance with the present 
invention. A main picture image has one or more corresponding 
graphic images, which have different sizes and color depths. 

[0036] As shown, the main picture of size 1920x1080 pixels 
has three different associated graphic images, a graphic image of size 
15 1920x1080 pixels, a graphic image of size 1280x1080 pixels, and a 
graphic image of size 640x1080 pixels. 

[0037] The three graphic images have different color depths. 
The 1920x1080 graphic image has an 8-bit color depth, the 
1280x1080 graphic image has an 8-bit or 16-bit color depth, and the 
20 640x1080 graphic image has an 8-bit, 16-bit, or 24-bit color depth. 

[0038] As shown in FIG. 4, a plurality of different graphic 
images may be simultaneously overlaid on one main picture image 
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and the plurality of graphic Images may have different sizes and 
color depths. 

[0039] An optical disk reproducing apparatus determines the 
degree of importance of each graphic image to be overlaid based on 
5 the contents thereof and displays the graphic image with a color 
depth proportional to the degree of importance. For example, an 
image of the highest importance is displayed with 24-bit color depth, 
while an image of the lowest importance is displayed with 8-bit color 
depth. 

10 [0040] In a flow diagram shown in FIG. 5, the optical disk 

reproducing apparatus generates a graphic image of a maximum 
color depth of 24 bits (S10) and adjusts the color depth for the 
graphic image depending on the degree of importance of the contents 
and size thereof (SI 1). 

15 [0041] If 8-bit color depth is selected (SI 2), the optical disk 

reproducing apparatus generates an 8-bit color graphic image and 
palette information using corresponding navigation control 
information. Similarly, if 16-bit color depth is selected (SI 3), the 
optical disk reproducing apparatus generates a 16-bit color graphic 

20 image and palette information using corresponding navigation 
control information. 

[0042] If 24-bit color depth is selected (SI 4), the color depth of 
the graphic image generated at step S10 remains unchanged. The 
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generated graphic image is displayed in various ways according to 
the display control information, as described above with reference to 
FIGS. 1 and 2. 

[0043] In the case where only one color depth is used, the data 
5 size of a graphic image is large when a high color depth is used. On 
the other hand, the data size of a graphic image is small but the 
quality of the graphic image is deteriorated when a low color depth is 
used. 

[0044] This drawback can be overcome by employing a 
10 variable color depth. In other words, the color depth of a graphic 
image is adjusted depending on the image size, bit rate, data amount, 
target application, or other conditions. 

[0045] For example, the size of a graphic image is determined 
by the product of the numbers of horizontal and vertical pixels; 
15 therefore an image of size 720x480 pixels and an image of size 
1440x240 pixels are regarded as being of the same size. 

[0046] The number of pixels varies depending on the color 
sampling format (e.g., Y:Cb:Cr = 4:4:4, 4:2:2, 4:2:0) and the bit rate 
of a graphic image may vary depending on the video quality, the 
20 number of audio streams, etc. The color depth can also be adjusted 
variably depending on these conditions. 

[0047] In addition, because the contents of a graphic image 
differ from application to application, the color depth can be adjusted 



9 



Attorney.Docket No. 1 740-00005 8/US 



depending on the target application. All or one of these conditions 
can be used in determining the color depth of a graphic image. When 
multiple graphic images are linked to a main picture image, the 
multiple graphic images may have different color depths. 
5 [0048] The size of a graphic image cannot exceed the size of 

the main picture image and the maximum possible color depth for 
the graphic image is 24 bits. 

[0049] One embodiment of a method of managing graphic data 
for a high-density optical disk according to the present invention 
10 employs a multiple color palette structure in which multiple color 
palettes are defined in the navigation area and used for graphic 
images. In the multiple color palette structure, palettes are defined 
for each color depth that is less than 24 bits 

[0050] In the multiple color palette structure, fixed-size 
15 palettes as shown in FIG. 6 can be used, wherein every pixel value 
(e.g., R/G/B or Y/Cb/Cr) used in graphic images is defined in the 
palette information. 

[0051] In the multiple color palette structure, fixed-size 
palettes with null code as shown in FIG. 7 can be used, wherein null 
20 code is assigned to every color value of the palettes that are not 
actually used in graphic images and thereby the size of palettes can 
be reduced. 

[0052] In the multiple color palette structure, variable-size 



10 



Attorney Docket No. 1740-000058/US 



palettes as shown in FIG. 8 can be used, wherein only the pixel 
values that are actually used in graphic images are defined in the 
palettes. 

[0053] Palette search information such as a palette number, 
5 which points to a palette among the multiple palettes, is defined in 
each of graphic image information and thereby the palette 
information can be shared by multiple graphic images. 

[0054] Fig. 9 illustrates a portion of the navigation information 
for graphic images recorded on a high density recording medium 
10 such as a BD-ROM. As shown in FIG. 9, for example, color palette 
information including multiple palettes and graphic image 
information about a plurality of individual graphic images are 
defined in the navigation information. 

[0055] The graphic image information about a plurality of 
15 individual graphic images may include data size, palette number, and 
color depth for each graphic image. The palette number field may 
store one or more palette numbers so that the graphic image may be 
associated with more than one palette in the palette information. 

[0056] As shown, the graphic image information may also 
20 include information about groups of graphic images instead of the 
information about a plurality of individual graphic images. This 
information may include the same graphic information as for 
individual graphic images. The palette information, however, may be 
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shared by the groups of graphic images, thereby effectively reducing 
the size of palette information recorded on a high-density recording 
medium such as a BD-ROM. 

[0057] In another embodiment of a method of managing 
5 graphic data for a high-density optical disk according to the 
invention, the main picture image is overlaid with graphic images by 
a-blending. If an individual blending ratio is assigned to each pixel 
value as done in the DVD-Video standard, the resultant data size 
becomes large. In this embodiment, therefore, all pixel values are 
10 divided into several pixel groups and a blending ratio is assigned to 
each pixel group. 

[0058] As shown in FIG. 10, pixels having values equal to or 
less than M (e.g., 256) are divided into n groups and an individual 
blending ratio a (bn ~ bl) is assigned to each of the groups. The 
15 dividing task is performed based on pixel values or color properties. 

[0059] The n groups may be obtained by dividing pixels at 
non-uniform intervals. An individual blending ratio may be assigned 
to each color palette (e.g., indicated as part of the palette 
information), each graphic image, each title of main video, or each 
20 playlist. 

[0060] When each color palette is given a blending ratio, the 
blending ratio may be shared by a plurality of graphic images 
through the navigation information as described above with reference 
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to FIG. 9. 

[0061] The DVD-Video standard employs a general run-length 
coding method to reduce the data size of 2-bit color depth graphic 
images using a run-length encoder 11 and a run-length decoder 12, 
5 as shown in FIG. 11. In this case, the coding efficiency deteriorates 
as the color depth increases. 

[0062] Consequently, a coding method suitable for a high- 
density optical disk is required. In a first embodiment of the 
invention shown in FIG. 12, a discrete cosine transform (DCT) 
10 method is used, wherein high-resolution graphic data is encoded 
with compression into JPEG images. 

[0063] In this embodiment, high-resolution graphic data is 
recorded on a BD-ROM 20 in accordance with the JPEG format by a 
DCT-based encoder comprising a forward discrete cosine transform 
15 (FDCT) unit 21, a quantizer 22, and an entropy encoder 23 and 
JPEG graphic images are reproduced from the BD-ROM 20 by a 
DCT-based decoder comprising an entropy decoder 24, a dequantizer 
25, and an inverse DCT unit 26. 

[0064] In the case where a graphic image is encoded in 
20 accordance with the JPEG format, the graphic image is managed in a 
similar way that still images are recorded and managed. The FDCT 
unit 21 transforms a graphic image from the spatial domain to the 
frequency domain on an 8x8 block basis. 
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[0065] The quantizer 22 quantizes the data transformed to the 
frequency domain and the entropy encoder 23 removes spatial 
redundancy from the quantized data. 

[0066] The entropy decoder 24, dequantizer 25, and IDCT unit 
5 26 perform the reverse operations of the encoding process. The 
quantization and dequantization processes may be skipped to 
prevent information loss. 

[0067] In a second embodiment of the invention shown in FIG. 
13, a predictive coding method is used, wherein high-resolution 
10 graphic data is encoded with compression into JPEG images. 

[0068] In this embodiment, high-resolution graphic data is 
recorded on a BD-ROM 30 in accordance with the JPEG format by a 
lossless encoder comprising a predictor 31 and an entropy encoder 
32, and JPEG graphic images are reproduced from the BD-ROM 30 
15 by a lossless decoder comprising an entropy decoder 33 and a 
predictor 34. 

[0069] The predictor 31 calculates a prediction value of each 
pixel and codes the difference between the real value and the 
prediction value of each pixel. The predictors 31 and 34 may be 
20 constructed as a single module. 

[0070] The entropy encoder 32 removes spatial redundancy 
from the data from the predictor 31. The entropy decoder 33 and 
predictor 34 perform the reverse operations of the encoding process. 
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No information loss takes place during the encoding process or 
decoding process because quantization and dequantization are not 
included. 

[0071] In a third embodiment of the invention shown in FIG. 
5 14, a discrete cosine transform (DCT) method is used, wherein high- 
resolution graphic data is encoded in accordance with MPEG2 I- 
picture format. 

[0072] As described above with reference to FIG. 12, high- 
resolution graphic data is recorded on a BD-ROM 40 in accordance 
10 with the MPEG2 I-picture format by a DCT-based encoder comprising 
a forward discrete cosine transform (FDCT) unit 41, a quantizer 42, 
and an entropy encoder 43 and MPEG2 I-picture formatted graphic 
images are reproduced from the BD-ROM 40 by a DCT-based 
decoder comprising an entropy decoder 44, a dequantizer 45, and an 
15 inverse DCT unit 46. 

[0073] The MPEG2 I-picture format and JPEG format are 
similar in that both formats use DCT encoding/ decoding. However, 
they use different quantization and entropy encoding tables. In 
addition, the bit stream syntaxes of the two methods are also 
20 different. 

[0074] In a fourth embodiment of the invention shown in FIG. 
15, a statistical coding method is used, wherein high-resolution 
graphic data is encoded by entropy coding. 

15 
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[0075] In this embodiment, high-resolution graphic data is 
recorded on a BD-ROM 50 by an entropy encoding unit comprising a 
run-length encoder 51 and a variable length coding (VLC) encoder 52. 
Graphic images are reproduced from the BD-ROM 50 by an entropy 
5 decoding unit comprising an entropy decoder 53 and a VLC decoder 
54. 

[0076] In the case where successive pixels having the same 
value exist, the run-length encoder 51 reduces the data size by 
expressing the successive pixels by pixel value and its run-length. 
10 For example, pixels of '55533333333388888' are expressed by 
5(3),3(9),8(5). 

[0077] Based on the statistics of the run-length encoding 
results, the VLC encoder 52 assigns short-length codes to values of 
high frequency of appearance and long-length codes to values of low 
15 frequency of appearance. The Huffman encoding or arithmetic 
encoding method used in the MPEG or JPEG format may be 
employed. 

[0078] In a fifth embodiment of the invention shown in FIG. 16, 
high-resolution graphic data is encoded in accordance with a format 
20 identical to the still image coding format. 

[0079] In this embodiment, high-resolution graphic data is 
recorded on a BD-ROM 60 and graphic images are reproduced from 
the BD-ROM 60 in accordance with the still image coding format. 
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[0080] In this case, the structure for stream decoding is 
relatively simple and a single image encoder and decoder are shared 
by still image processing and graphic image processing because 
graphic images and still images have the same format. The image 
5 encoder may be a JPEG encoder, MPEG2 I-picture encoder, etc. 

[0081] In the first and third embodiments of the invention 
described above with reference to FIGS. 12 and 14, the quantization 
is performed according to a flow diagram illustrated in FIG. 17. 

[0082] A graphic image is generated (S20) and a quantization 
10 step size is set (S21). The graphic image is encoded (S22) with the 
given step size, and the size of the encoded image is examined. If the 
size does not exceed a prescribed maximum data amount, the 
encoded image is recorded on the optical disk (S25); and otherwise, 
steps S22 and S23 are repeated after the quantization step size is 
15 adjusted (S24). 

[0083] Fig. 18 illustrates a schematic diagram of an 
embodiment of an optical disk recording and reproducing apparatus 
according to the present invention. As shown, an AV encoder 9 
receives and encodes data (e.g., movie video and audio data, only 
20 audio data, and/or still image data). The AV encoder 9 outputs the 
encoded data along with coding information and stream attribute 
information. A multiplexer 8 multiplexes the encoded data based on 
the coding information and stream attribute information to create, for 
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example, an MPEG-2 transport stream. A source packetizer 7 
packetlzes the transport packets from the multiplexer 8 into source 
packets in accordance with the audio/video format of the optical disk. 
As shown in Fig. 18, the operations of the AV encoder 9, the 
5 multiplexer 8 and the source packetizer 7 are controlled by a 
controller 10. The controller 10 receives user input on the recording 
operation, and provides control information to AV encoder 9, 
multiplexer 8 and the source packetizer 7. For example, the controller 
10 instructs the AV encoder 9 on the type of encoding to perform, 
10 instructs the multiplexer 8 on the transport stream to create, and 
instructs the source packetizer 7 on the source packet format. The 
controller 10 further controls a drive 3 to record the output from the 
source packetizer 7 on the optical disk. 

[0084] The controller 10 also creates navigation and 
15 management information for managing reproduction of the data being 
recorded on the optical disk. For example, based on information 
received via the user interface (e.g., instruction set saved on disk, 
provided over an intranet or internet by a computer system, etc.) the 
controller 10 controls the drive 3 to record the data structures of Figs. 
20 9 on the optical disk. 

[0085] During reproduction, the controller 10 controls the drive 
3 to reproduce this data structure. Based on the information 
contained therein, as well as user input received over the user 

18 



Attorney Docket No. 1 740-00005 8/US 



interface (e.g., control buttons on the recording and reproducing 
apparatus or a remote associated with the apparatus), the controller 
10 controls the drive 3 to reproduce the data from the optical disk. For 
example, as discussed above with respect to the embodiments of the 
5 present invention, a still image or still images may be reproduced 
based on the navigation information provided in a still information file. 

[0086] The reproduced source packets are received by a source 
depacketizer 4 and converted into a data stream (e.g., an MPEG-2 
transport packet stream). A demultiplexer 5 demultiplexes the data 
10 stream into encoded data. An AV decoder 6 decodes the encoded data 
to produce the original data that was feed to the AV encoder 9. During 
reproduction, the controller 10 controls the operation of the source 
depacketizer 4, demultiplexer 5 and AV decoder 6. The controller 10 
receives user input on the reproducing operation, and provides control 
15 information to AV decoder 6, demultiplexer 5 and the source 
packetizer 4. For example, the controller 10 instructs the AV decoder 
9 on the type of decoding to perform, instructs the demultiplexer 5 on 
the transport stream to demultiplex, and instructs the source 
depacketizer 4 on the source packet format. 
10 [0087] While Fig. 18 has been described as a recording and 

reproducing apparatus, it will be understood that only a recording or 
only a reproducing apparatus may be provided using those portions of 
Fig. 18 providing the recording or reproducing function. 
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[0088] The data structure of the high density recording 
medium for, and the methods and the apparatuses of, managing 
graphic data for a high-density optical disk in accordance with the 
invention allow high-resolution graphic images to be overlaid on 
5 main video reproduced from the high-density optical disk with 
various sizes and color depths. 

[0089] While the invention has been disclosed with respect to a 
limited number of embodiments, those skilled in the art, having the 
benefit of this disclosure, will appreciate numerous modifications and 
10 variations there from. For example, while described with respect to a 
Blu-ray ROM optical disk in several instances, the present invention is 
not limited to this standard of optical disk or to optical disks. It is 
intended that all such modifications and variations fall within the 
spirit and scope of the invention. 
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